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A BRIEF INTRODUCTION TO HILBERT SPACE FRAME THEORY AND ITS 

APPLICATIONS 

PETER G. CASAZZA AND RICHARD G. LYNCH 


Abstract. This is a short introduction to Hilbert space frame theory and its applications for those outside 
the area who want to enter the subject. We will emphasize finite frame theory since it is the easiest way to 
get into the subject. 
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1. Reading List 

For a more complete treatment of frame theory we recommend the books of Han, Kornelson, Larson, and 
Weber [SI], Christensen m, the book of Casazza and Kutyniok [32] , the tutorials of Casazza [531 [33] and 
the memoir of Han and Larson m- For a complete treatment of frame theory in time-frequency analysis we 
recommend the book of Grochenig [55] . For an introduction to frame theory and filter banks plus applications 
to engineering we recommend Kovacevic and Chebira |64j . Also, a wealth of information can be found at 
the Frame Research Center’s website [53] . 

2. The Basics of Hilbert Space Theory 

Given a positive integer N, we denote by the real or complex Hilbert space of dimension N. This is 
either or with the inner product given by 

N 

{x,y) ='^aA 

for X = (ai, a 2 , • • •, a^) and y = ( 6 i, ^ 2 , * * * ^ ^n) and the norm of a vector x is 

Ikf = {x,x). 

For x,y £ H^, || X — y|| is the distance from the vector x to the vector y. For future reference, note that in 
the real case, 

Ik - yf = {x- y,x- y) 

= {x, x) - {x, y) - {y, x) + (y, y) 

= |kf-2(x,y) + ||yf 

and in the complex case we have 

{x, y) + (y, x) = {x, y) + (x, y) = 2Re {x, y), 

where Re c denotes the real part of the complex number c. We will concentrate on finite dimensional Hilbert 
spaces since it is the easiest way to get started on the subject of frames. Most of these results hold for 
infinite dimensional Hilbert spaces and at the end we will look at the infinite dimensional case. 

The next lemma contains a standard trick for calculations. 

Lemma 2.1. If x £ and {x, y) = 0 for all y £ then x = 0. 

Proof. Letting y = x we have 

0 = {x,y) = (x,x) = Ikip, 

and so X = 0 . □ 

Definition 2.2. A set of vectors {ei}fL^ in is called: 

(1) linearly independent if for any scalars 

M 

OiCi = 0 Oi = 0, for all* = 1, 2, • • •, M. 

i=l 

Note that this requires 7 ^ 0 for alH = 1, 2, • • •, M. 

( 2 ) complete (or a spanning set) if 

span{ei}ff^i = 

(3) orthogonal if for all i 7 ^ j, (ci, Cj) = 0. 

(4) orthornormal if it is orthogonal and unit norm. 

(5) an orthonormal basis if it is complete and orthonormal. 

The following is immediate from the definitions. 
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Proposition 2.3. If orthonormal basis for then for every x we have 

N 

X = y^(x,e^)ei. 

From the previous proposition, we can immediately deduce an essential identity called Parseval’s Identity. 

Proposition 2.4 (Parseval’s Identity). If is an orthonormal basis for then for every x € 

we have 

N 

Ikf = Yi 

i=l 

Some more basic identities and inequalities for Hilbert space that are frequently used are contained in the 
next proposition. 

Proposition 2.5. Let x,y G H^. 

(1) Cauchy-Schwarz Inequality.- 

l(^,2/)l<lkllll2/ll, 

with equality if and only if x = cy for some constant c. 

(2) Triangle Inequality; 


lk + y||<||x|| + ||y||. 

(3) Polarization Identity; Assuming is real, 

{x,y) = ^ [\\x + yf- \\x-y\\^] . 

If is complex, then 

{x,y) = f\\\x + yf - \\x-yf +i\\x + iyf -iWx-iyW^]. 


(4) Pythagorean Theorem; Given pairwise orthogonal vectors 

^ M 

l2 


M 

E 


Xq 


= Ei 

i=l 


Xi 


Proof. (1) The inequality is trivial if ?/ = 0. If y ^ 0, we may assume ||y|| = 1 by dividing through the 
inequality with ||?/||. Now we compute: 

0 < ||a;- {x,y)yf 

= Ikf - 2{x,y){x,y) + \{x,y)f\\yf 

= \\xr-\{x,y)\^ 

= \\xr\\yr-\(x,y)\^. 

Note that the strict inequality would be equality if a; = cy. 

(2) Applying (1) to obtain the second inequality: 

\\x + yr = \\xf+ 2 Re{x,y) + \\yf 
<\\xr + 2\{x,y)\ + \\yr 
<\\xr + 2\\x\\\\y\\ + \\yr 
= {\\x\\ + \\y\\r. 

(3) We compute assuming is a real Hilbert space: 

lla; + yf - ||a; - yf = Ikf + 2{x, y) + Wyf - (Ikf - 2(a;, y) + bf) 

= Hx,y). 


The proof in the complex case is similar. 
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(4) Since {xi^Xj) = 0 for all i ^ we have 

M 

2=1 


M 


M 


\i^i i=i 
M 


{Xi,Xj) 

M 


2=1 

M 




□ 


We now look at subspaces of the Hilbert space. 

Definition 2.6. Let W,V be subspaces of 

(1) A vector x € is orthogonal to a subspace W, denoted a; A W if 

(x, y) = 0 for all y G W. 

The orthogonal complement of W is 

W'*‘ = {x G H : a; A W}. 

(2) The subspaces W, V are orthogonal subspaces, denoted W A H if W C ^ that is, 

(x, y) = 0 for all X G W, y £ V. 

A simple calculation shows that W-^ is always closed and so if W is closed then W-^-^ = W. Fundamental 
to Hilbert space theory are orthogonal projections as defined next. 

Definition 2.7. An operator P : — >■ is called a projection if = P. It is an orthogonal 

projection if P is also self-adjoint (See definition [AS]) . 

For any subspace W C there is an orthogonal projection of HI onto W called the nearest point 
projection. One way to define it is to pick any orthonormal basis {ei}fLi for W and define 

K 

Px = 

2=1 


Note that for all j = 1, 2, • • •, we have 

K 


I K \ ^ 

{Px,ej) = ( X(^Ai)ei,ejA = X(®> o)(ei, e^) = (x,ej). 

' i=l ' i=l 


We need to check that this operator is well defined, that is, we must show it is independent of the choice 
of basis. 

Lemma 2.8. If {ei}^i and {gi}fLi o.re orthonormal bases for W, then 

K K 

2=1 2=1 


K 

2=1 


Af. 

i=i \ 



Proof. We compute: 
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K j K 

i=l \j=l 
K 


□ 


In this case, Id — P is also an orthogonal projection onto W^. This projection maps each vector in 
onto the unique nearest vector to x in W. In particular, ||Px|| < ||x|| for all x S H. 

Proposition 2.9. Let P be an orthogonal projection onto a subspace W. Then 

||x — Px\\ < ||x — y\\, for all y GW. 

Proof. Choose an orthonormal basis for W. Then 

Re{x,y) < \{x,y)\ 

K 


'^{x,ei){y,ei) 

K 

'^{Px,ei){y,ei) 


2=1 
/ K 




^ 2=1 


\ 1/2 / ^ \ 1/2 


<\\P^\\\\y\\ 

<li\\pxr+\\yr) 


Therefore, 


\x-yf = 
> 


\yf - 2Re {x,y) 
\yf-(\\Pxr + \\yf) 
iPxf 

\Pxr-2\\Pxr 
\Pxf - 2{Px,Px) 
|Px||^ — 2{Px, x) 


= ||x-Pxf. 

Another important concept is taking orthogonal sums of subspaces of a Hilbert space. 


□ 


Definition 2.10. If (the index set I is allowed to be infinite) are subspaces of a Hilbert space 

their orthogonal direct sum is 

={( Xi)i^i : Xi G Wi, and E W^iW"^ < oo} 

\i£l / /o 


and inner product defined by 


{{xi)i(zi,{y^)i(zi) = '^{xi,yi). 




It follows that 
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3. The Basics of Operator Theory 

Definition 3.1. A linear operator T : between Hilbert spaces and satisfies: 

T{ax + by) = aT{x) + bT{y) for all x,y £ and scalars a,b. 

The operator norm is 

IITII = snp \\Tx\\ 

11 ^ 11=1 

= sup llTxll 
lkll<i 


.#0 Ikll ■ 

From the definition, for all x £ we have ||Ta;|| < ||T|l||a;||. Furthermore, if T : Ill'll —>■ and 

S' : ^ then 

|lSTx||<||S||||rx||<|lS||||r||||x|l 

showing that 

nil’ll <ll^lll|r||. 

Linear operators on finite spaces can always be represented as a matrix, so we can work with linear 
operators and their matrices interchangeably. 

Definition 3.2. Let T : —>■ be a linear operator, let {ei}f^i be an orthonormal basis for and 

let be an orthonormal basis for The matrix representation of T (with respect to these 

orthonormal bases) is T = {aij\i<i<N.i<j<K where 

dij = (Tci^gj). 

The following definition holds some fundamental concepts that we often work with when dealing with 
linear operators. 

Definition 3.3. Let T : be a linear operator. 

(1) The kernel of T is 

kevT = {x £ll^ :Tx = 0}. 

The range of T (or image of T) is 

ranT = {Tx : x £ H^}. 

The rank of T, denoted rank T is the dimension of the ranT. A standard result from linear algebra 
known as the rank-nullity theorem states 

N = dim ker T + rank T. 

(2) T is injective if kerT = {0}, and surjective if ranT = H^. ft is bijective if it is both injective 
and surjective. 

(3) The adjoint operator T* : —>■ is defined by: 

{Tx, y) = {x, T*y) for all x G y£ 

Note that T** = T and {S + T)* = S* +T*. 

(4) T is bounded if ||T|| < oo. 

(5) If = H*”, then T is invertible if it bounded and there is a bounded linear map S : 

so that TS = ST = Id. If such an S exists, it is unique and we call it the inverse operator of T 
and denote it by S' = T~^. In the finite setting, the existence of an inverse is equivalent to T being 
any of bounded, injective, or surjective. 

A useful alternative method that we will use later for calculating ||T|| is given in the following proposition. 
Proposition 3.4. If T : —>• is a linear operator, then 

IITII =sup{|(Tx,y)|:||x|| = |M| = l}. 



FRAMES AND THEIR APPLICATIONS 


7 


Proof. For ||x|| 

Hence, 

Conversely, 


1 = II2/11, Cauchy-Schwarz gives 

|(Tx, 2 /)|<||T:r|||| 2 /||<||T||||:r|| = ||r||. 

||T||>sup{|(rx, 2 /)|: INI = 112/11 = 1}. 


sup{|(Ta;, 2 /)| : ||a;|| = || 2 /|| = 1} 


> sup 


= sup 


Tx 


Tx 


: ||a;|| = 1 and Tx 0 


\\Txf 


.. .=1 ll^^ll 

= sup llTxll = ||r||. 
Ikll=l 


The following gives a way to identify operators. 

Proposition 3.5. If S,T : —>■ are operators satisfying 

{Tx, y) = 0, for all x,y G H^, 


then T = 0. Hence, if 


{Tx, y) = {Sx, y) for all x,y G H^, 


then S = T. 

Proof. Given x G H^, by letting y = Tx we obtain: 

0 = {Tx,Tx) = llTxlP = 0, 


and so Tx = 0 and T = 0. 


□ 


□ 


There are important relationships between the kernel of T and the range of T* and vice versa. 

Proposition 3.6. Let T : —>■ be a linear operator. Then 

(1) kerT = [ranT*]-*-. 

(2) [kerT]-L = ranT*. 

(3) kerT* = [ran T]^. 

(4) [kerT*]-*-= ranT. 

Proof. (1) We have x G ker T if and only if Tx = 0 then for all y G if and only if {Tx, y) = 0 = (x, T*y} 
for all y G if and only if x € [ranT*]-*-. 

(2) Observe from (1) that: 

[kerT]-^ = [T*(H^)]-L-L = T*(H^) = ranT*. 

The relations (3) and (4) follow by replacing T by T* in (1) and (2). □ 

We also have the following relationships for adjoint operators. 

Proposition 3.7. For linear operators T : —>■ and S : —>• yjg have: 

(1) {ST)* = T*S*. 

(2) ||T*|| = ||T||. 

(3) ||T*T|| = ||Tf. 

Proof. (1) We compute: 

{x,{ST)*y) = {STx,y) 

= {Tx,S*y) 

= {x,T*S*y). 

(2) We use Proposition 13.41 to get: 

||T||=sup{|(Tx, 2 /)|:||x|| = 112/11 = 1} 
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= sup{|(a;,r*?/)| : ||a;|| = ||?/|| = 1} 

= \\T*\\. 

(3) We know that ||r*r|| < ||r*||||r|| = ||T|p. On the other hand, for all ||x|| = 1 via Cauchy-Schwarz, 

\\Txr = {Tx,Tx) = {T*Tx,x) < \\T*Tx\\\\x\\ < \\T*T\\\\x\\ = \\T*T\\. 

Hence, llTf < ||r*T||. □ 

Definition 3.8. Let T : —>■ be an injective linear operator. Then (T*T)~^ exists and the Moore- 

Penrose inverse of T, denoted by T\ is defined by 

The map is a left inverse, that is, = I. 

Definition 3.9. A linear operator T : —>■ is called: 

(1) self-adjoint, ifH^ =11^ and r = T*. 

(2) normal, if and T*T = TT*. 

(3) an isometry, if ||ra;|| = ||a;|| for all x € 

(4) a partial isometry if T restricted to [kerT]-*- is an isometry. 

(5) positive , if = H^, T is self-adjoint, and 

{Tx, a;) > 0 for all a; G H. 

In this case we write T > 0. 

(6) unitary, if TT* = T*T = Id. 

It follows that TT* and T*T are self-adjoint for any operator T. 

Example 3.10. A fundamental example of a positive, self-adjoint operator important in frame theory is to 
take vectors 4) = dehne the operator: 

M 

Sx = '^{x,ipi)ip^. 

It follows that 

M M 

{Sx,x) = '^{x,(p^){(p,,x) = ^ |(a;,(^i)p = {x,Sx) 

showing that it is positive and self-adjoint. This operator is called the frame operator of the sequence $. 

Note that given two positive operators S and T, the sum S' -|- T is a positive operator but ST may not be 
as the next example shows. 

Example 3.11. Take S : —?► to be the operator defined by 


Xi 


■ 0 

-1 ■ 


Xi 


-X2 

. ^2 


1 

0 


. ^2 


Xi 


Then {Sx,x) = 0 for all a; G so that S is positive. However, 


Xi 


■ -1 

0 ■ 


Xl 


-Xl 

. *2 


0 

-1 


X2 


-X2 


so that {S^x,x) = —||a;||^ for all a; G and hence S^ is not positive. 

Nevertheless, we can define inequalities for positive operators: 

Definition 3.12. If S, T are positive operators on H^, we write S<T if T — S>0. 

Proposition 3.13. Let T : —>■ be a linear operator. 

(1) the following are equivalent: 

(a) T is self-adjoint. 

(b) {Tx,y) = {x,Ty), for all x,y e H^. 

(2) The following are equivalent: 
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(a) T is an isometry. 

(b) T*T = Id. 

(c) {Tx,Ty) = {x,y), for all x,y € . 

(3) The following are equivalent: 

(a) T is unitary. 

(h) T and T* are isometries. 

(c) T is an isometry and T* is injective. 

(d) T is a surjective isometry. 

(e) T is bijective and T~^ = T*. 

(4) IfU is any unitary operator, then ||T|| = ||TJ7|| = ||J7T||. 


Proof. (1) Applying Proposition 13.51 we have T* = T if and only if {Tx, y) = {T*x, y) for all x, y if and only 
if {Tx,y) = {x,Ty) for all x,y. 

(2) (a) => (6): We prove the real case, but the complex case is similar using the complex version of the 
Polarization Identity. We have by the (real) Polarization Identity that for any x,y G 

{x,y) = ^ {\\x + yf - ||a;-yf) 

= l{mx + y)f-\\nx-y)f) 

= i (llTxf + llTyf + 2{Tx, Ty) - [\\Txf + \\Ty\\^ - 2{Tx, Ty)]) 

= {Tx,Ty) 

= {T*Tx,y). 


So, T 

(b) 

(c) 


(3) 

( 6 ) 

(c) 

id) 


(e) 

(4) 


*T = Id by Proposition [331 

(c): For any x,y G we have 

{Tx,Ty) = {T*Tx,y) = {x,y). 


^ (a): (c) implies. 


\\Tx\\^ = {Tx,Tx) 
= {x,x) 

= lkf- 


(a) (6): This is immediate by the definitions and (2). 

=> (c): By (2, b) T* is injective. 

=> {d): We observe: 

= {0}-L = [kerT*]-^ = T(H^) = ranT. 

=> (e): Since T is bijective by assumption, S = T~^ exists. We compute using (2, b): 


T* = T*I = T*{TS) = {T*T)S = IS = S. 

^ (a): Immediate by the definitions. 

Since U is an isometry by (3), the result is now immediate from Lemma 13.41 


□ 


Definition 3.14. A linear operator T : —>■ is a Hilbert space isomorphism if for all x,y G 

we have 

{Tx,Ty) = {x,y). 

Two Hilbert spaces and are isomorphic if there is a Hilbert space isomorphism T : —>■ 


Proposition 13.131 21 implies that T is an isometry and T*T = Id for any Hilbert space isomorphism T. 
Thus, it is automatically injective. We see in the next proposition that every two Hilbert spaces of the same 
dimension are isomorphic. 


Proposition 3.15. Every two N-dimensional Hilbert spaces are Hilbert space isomorphic. Thus, any N- 
dimensional Hilbert space is isomorphic to . 

Proof. Let be an orthonormal basis of and let be an orthonormal basis of H^. The 

operator T given by: Tci = gi for all* = 1, 2, • • •, is clearly a Hilbert space isomorphism. □ 
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In the complex case, an operator T is self-adjoint if and only if {Tx, x) G R for any x. We need a lemma 
to prove this. 

Lemma 3.16. IfM^ is a complex Hilbert space and T : —>■ is a linear operator satisfying {Tx, x) = 0 

for all X G then T = 0, the zero operator. 

Proof We prove this by showing that (Tx, y) for all x,y G and then apply Proposition 13.51 to conclude 
that T = 0. Note by assumption that we have for all x,y, 

0 = (T(x + y),x + y) = {Tx, y) + {y, Tx) 

and 

0 = (T(x -b iy), x + iy) = i{Tx, y) - i{y, Tx). 

Thus, (Tx, y) = 0 for all x, y and therefore T = 0. □ 

Now we formally state the theorem and then prove it. 

Theorem 3.17. An operator T : —>• on a complex Hilbert space is self-adjoint if and only if 

(Tx,x) G M for any x G H^. 

Proof. We have that (Tx,x) G R for all x if and only if 

(Tx,x) = (Tx,x) = (x,Tx) = (T*x,x) for all x 

if and only if ((T — T*)x, x) = 0 for all x, which by Lemma [3. 161 happens if and only if T = T*. □ 

Corollary 3.18. If T : —>■ is a positive operator on a complex Hilbert space then T is self- 

adjoint. 

Remark 3.19. Notice that Theorem 13. 171 fails when the Hilbert space is real. This is mainly due to the fact 
that Lemma 13.161 fails, in particular, the operator given in Example 13. Ill is a specific counterexample. 

Next we introduce the concept of diagonalization, which is fundamental to studying the behavior of 
operators. 

Definition 3.20. Let T : —>■ be a linear operator. A nonzero vector x G is an eigenvector of 

T with eigenvalue A if 

Tx = Ax. 

The operator T is diagonalizable if there exists an orthonormal basis for consisting of eigenvectors for 

T. 


The above definition is not the standard one which states that an operator is diagonalizable if there is 
some basis consisting of eigenvectors for T. 

As an example, if T is a projection from we have 

{Px,x) = {P^x,x) = {Px,Px) = ||Tx||^, 

so that T is a positive operator. If P : —>■ W and dim W = m, then P has eigenvalue 1 with multiplicity 

m and eigenvalue 0 of multiplicity N — m. 

Definition 3.21. Let T : —>■ be an invertible positive operator with eigenvalues Ai > A 2 > • • • > 

Xn > 0. The condition number is 

The condition number is an important concept to frame theorists because its gives a way to measure 
redundancy, as we will see later. 

The following relationship holds for T*T and TT*. 

Proposition 3.22. If T : is any linear operator, then T*T and TT* have the same nonzero 

eigenvalues, including multiplicity. 

Proof. If T*Tx = Ax with A 7 ^ 0 and x 7 ^ 0, then Tx 7 ^ 0 and 

TT*(Tx) = T(T*Tx) = T(Ax) = ATx. 


□ 
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We will see in the next section that T*T may have zero eigenvalues even if TT* does not have zero 
eigenvalues. 

Further restrictions on T gives more information on the eigenvalues. The following result is a corollary of 
Proposition 13.131 

Corollary 3.23. Let T : he a linear operator. 

(1) If T is unitary, then its eigenvalues have modulus one. 

(2) If T is self-adjoint, then its eigenvalues are real. 

(3) IfT is positive, then its eigenvalues are nonnegative. 


Whenever T is diagonalizable, it has a nice representation using its eigenvalues and eigenvectors. It also 
gives an easy way to compute its norm. 

Theorem 3.24. IfT is diagonalizable, so that there exists an orthonormal basis {ei}^i of eigenvectors for 
T with respective eigenvalues then 

N 

Tx = Ai(x, ei)ei for all x £ 

Z = 1 

and 

||r|| = max |Ai|. 

l<i<JV 


Proof. Since {ei}^^ i® orthonormal, we can write any x as 


N 




and therefore 


N 


N 


N 


Tx = r( '^{x,ei)ei | = '^{x,ei)Tei = '^{x,ei)Xie 


N 

y^^Xi{x,ei)ei. 

2=1 


From this combined with Parseval’s identity, we get 

N N 

< max I Ay y] I (a:, Ci) 12 = max |Ay||a;f. 

l<i<N ^^ l<i<N 

2=1 2=1 

To see that there is an x for which ||Ta;|| obtains this maximum, let j be so that |Aj| is the maximum across 
all I Ail and then take x = Cj above. □ 


We can classify the diagonalizable operators. In the infinite dimensional setting this is called the Spectral 
Theorem. We will do a special case which is more instructive than the general case. Specifically, we will 
show that all self-adjoint operators are diagonalizable. We need a series of lemmas. 

Lemma 3.25. IfT is a self-adjoint operator on a Hilbert space then 

||T|| = sup |(Ta;,a;)|. 

Ikll=i 

Proof. We once again give the proof in the complex setting, but the same general idea works in the real case. 
To begin, set 

M := sup {|(Ta;,a;)|}. 

||x||=l 

We will first show that M < ||T||: For any y £ we have 

KTx,y)|<||Tx|||M|<||T||||x|||M|, 

and thus if ||a:|| = 1, then |(Ta;,a;)| < ||T||. Taking the supremum over all x £ such that ||x|| = 1, we get 

m<\\t\\. 

Next we will show that ||T|| < M: For any x,y £ H^, we have 

4Re {Tx, y) = {{Tx, x) + 2Re {Tx, y) + {Ty, y)) 

- {{Tx,x) - 2Re {Tx,y) -\- {Ty,y)) 
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= {T{x + y),x + y)- {T{x -y),x-y) 
where the fact that T is self-adjoint was used in the second equality. Hence, 

4Re(rx.„) = ||x + ,f(T(" + »t " + » 

-\\x-y\\^(T 


\\x + y\\J ’ Ik-h 2/11 

X — y \ X — y 


,lk-y||/ ’ \\x-y\\. 

< M(|k + 2 /f + ||x - 2 /f ) = 2M(|kf + || 2 /f). 

Note that there exists a. 9 G [0,27r) such that e^^{Tx,y) = \{Tx,y)\. Now, replace y with 6“*®?/ to obtain: 

4|(rx,2/)|<2M(|kf+ || 2 /f). 

Finally, if ||x|| = 1 and y = Ta:/||Ta:||, then 


llTxll = (Tx, 

Combining both steps gives ||T|| = M as desired. 


Tx 


< M. 


□ 


Lemma 3.26. IfT is normal then ||ra:|| = ||'r*a;|| for all x € H^. 
Proof. We compute: 

\\Txf = {Tx,Tx) 

= {T*Tx, x) 

= {TT*x,x) 

= {T*x,T*x) 

= \\T*xr. 


Lemma 3.27. IfT is normal and 


Tx = Xx 


for some x G and scalar X, then 


T*x = Xx. 


Proof. If T is normal, then T — X ■ Id is normal. Applying Lemma 13.261 gives 

Tx = Xx^ |l(r-A-/d)a;|| =0 
||(T-A-/d)*a;|| =0 
||T*a;-Axil = 0 
T*x = Xx. 


□ 


□ 


Finally, we will need: 

Lemma 3.28. IfT is normal and Tx = Xx, then 

T([xk)ckk. 

Proof. We have y T x ii and only if 

{Ty,x) = {y,T*x) = {y,Xx) = 0 

if and only ilTy T x. □ 

Now we are ready to prove the main theorem on diagonalization. 

Theorem 3.29. IfT is a self-adjoint, then T is diagonalizable. 
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Proof. By Lemma [3.251 we can choose x € with ||x|| = 1 and ||T|| = |(Tx,x)|. By Theorem 13.171 we 
know that {Tx,x) £ R, even if the Hilbert space is complex. Therefore, ||r|| = {Tx,x) or ||T|| = —{Tx,x). 
If ||r|| = {Tx,x), then 

\\iT-\\T\\-Id)xr = {Tx-\\T\\x,Tx-\\T\\x) 

= {Tx,Tx) + \\Tf - 2\\T\\{Tx,x) 

<2\\T\\{\\T\\-{Tx,x)) 

= 0 

and so Ai = ||T|| is an eigenvalue for T with eigenvector ei = x. On the other hand, if ||r|| = —{Tx,x), then 
II (T + ||r|| • Id)x\\ = 0 by a similar argument, so that Ai = —||T||. 

Now, if we restrict the operator T to [ei]-*-, we have by Lemma [3.281 that 

T’lkil-L : [ei]-^ ^ [ei]-^, 

and is still self-adjoint. So we can repeat the above argument to get a second orthogonal eigenvector of norm 
one and eigenvalue of the form: 

A2 = ||r|[gj]j_ II or A2 =-||T|[ej]j_ ||, 62 G [ei]-^. 

Continuing, we get a sequence of eigenvalues {Ai}^^ so that 

= 11^1 [span II ^ “ 11^1 [span II 

with corresponding orthonormal eigenvectors □ 

It is possible to take well-defined powers of an operator when it is positive, invertible, and diagonaliz- 
able. 

Corollary 3.30. Let T he an positive, invertible, diagonalizable operator on with eigenvectors {ei}^i 
and respeetive eigenvalues {A^}^]^. For any nonnegative a gM. we define the operator T“ by 

N 

T°‘x = ^ A“(a;, ei)ei, for all x G H^. 

i=l 

Thus, r“ is also positive operator and for all a,b £ M.. In particular, T~^ and 

are positive operators. We also note that the definition makes sense for nonnegative powers when T is not 
invertible. 

Notice that Corollary 13.181 combined with Theorem 13.291 gives that all positive operators on a complex 
Hilbert space are diagonalizable. However, it is possible for a positive operator on a real Hilbert space to 
not be diagonalizable and hence we cannot obtain powers as defined above. One again, the operator S as 
given in Example 13.Ill provides a counterexample since this operator has no eigenvalues over the reals. 

We conclude this section with the concept of trace. In order for it to be well-defined, we need the following 
proposition. 

Proposition 3.31. Let T be a linear operator on and let {ei}fLi and {gi}fLi orthonormal bases for 
H^. Then 

N N 

'^{Te„ei) = '^{Tg„gi). 

N N / N 

'^{Tei,ei) = ^('^{Te„gj)gj,ei 
1^1 \j^l 

N N 

= '^'^{Tei,gj){gj,e,) 
i=i i=i 
N N 

= '^'^{ei,T*gj){gje,) 
i=i j=i 


Proof. We compute: 
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N / N 

j=i \i=i 
N 

= Y,{9j,T*g,) 

N 

= '^{Tgj,gj)- □ 

3 = 1 

Definition 3.32, Let T : —>■ be an operator. The trace of T is 

N 

TrT = ^(Tei,ei), 

where is any orthonormal basis of The previous proposition shows that this quantity is inde¬ 

pendent of the choice of orthonormal basis and therefore the trace is well-defined. 

When T is diagonalizable, the trace can be easily computed using its eigenvalues. 

Corollary 3.33. IfT : —>■ is a diagonalizable operator with eigenvalues then 

N 

Tr r = ^A,. 

Proof. If {ciliLi is an orthonormal basis of eigenvectors associated to {Ai}^^, then 

N M N 

Tr T = '^{Tei,ei) = '^{Xiei,ei) ='^Xi. □ 

i—l i—1 i—1 

4. Hilbert Space Frames 

Hilbert space frames were introduced by Duflin and Schaeffer in 1952 [48] to address some deep questions 
in non-harmonic Fourier series. The idea was to weaken Parseval’s Identity as given in Proposition |2]4| We 
do not need to have an orthonormal sequence to have equality in Parseval’s identity. For example, if {ei}iLi 
and ^.re orthonormal bases for a Hilbert space then 

f 1 1 1 1 1 1 F 

i 71''’ cl® ’ cl'*’ cl®’"' ’ cl'"’ 71’" 

satisfies Parseval’s identity. 

Definition 4.1. A family of vectors is a frame for a Hilbert space if there are constants 

0 <A<i?<ooso that for all x G 

M 

(4.1) A||a;f <^|(a;,^,)P<H||xf. 

We include some common, often used terms: 

• The constants A and B are called lower and upper frame bounds, respectively, for the frame. 
The largest lower frame bound and the smallest upper frame bound are called the optimal frame 
bounds. 

• li A = B this is an A-tight frame and if A = H = 1 this is a Parseval frame. 

• If W^PiW = W^PjW for all i,j G I, this is an equal norm frame and if ||(/3i|l = 1 for alH € / this is a 

unit norm frame. 

• If ||(/3i|| = 1 for i G I and there exists a constant c so that \{(pi, = c for all i j, then the frame 

is called an equiangular frame. 

• The values {(x, are called the frame coefficients of the vector x with respect to the frame. 

• The frame is a bounded frame if mini<i<M ll^.||>o. 
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• If only the right hand inequality holds in (14.11) we call a S-Bessel sequence or simply Bessel 

if explicit reference to the constant is not needed. 

It follows from the left-hand-side of inequality (HU), that the closed linear span of a frame must equal the 
Hilbert space and so M > N. In the finite dimensional case, spanning is equivalent to being a frame. 

Proposition 4.2. $ = is a frame for if and only if span $ = H^. 


Proof. We only need to prove the z/part. For the right hand inequality, 

M M 

i=l i=l 

where 

M 

i=l 

For the left hand inequality, we proceed by contradiction. Suppose we can find a sequence {xn}'^=i with 
||a;„|| = 1 (by scaling) so that 

M 

n 

and thus there is a norm convergent subsequence of say Xn^ x. Then 

M M 

E = lim E = ^- 

^ J^OO -f—^ ' 


That is, X J- (fii for all z = 1, 2, • • •, M and so $ does not span H'^. 


□ 


Spanning does not necessarily imply that a sequence is a frame when the space is infinite dimensional. 
For example, suppose is an orthonormal basis for an infinite dimensional Hilbert space H. Then the 

sequence spans the space, but is not frame since a lower frame bound does not exist. 

It is important to note that there are no restrictions put on the frame vectors. For example, if {ei}fLi is 
an orthonormal basis for H^, then 

{ei, 0, 62, 0, 63, 0, • • •, Cn , 0} 

and 

/ 62 62 63 63 63 cn On \ 

r'’7!’7!’■ ■ ■ ’ 7^’■ ■ ■ ’ 

are both Parseval frames for H^. That is, zeros and repetitions are allowed. 

The smallest redundant family in has three vectors and can be chosen to be a unit norm, tight, and 
equiangular frame called the Mercedes Benz Frame, given by 



Drawing the vectors might illuminate where it got its name. 

4.1. Frame Operators. If is a frame for with frame bounds H, B, define the analysis operator 

of the frame T : to be 

M 

Tx = '^{x,(f^)ei = for all x e 

2 = 1 

where is the natural orthonormal basis of . It follows that 

M 

= E 

2=1 

so ||r|p is the optimal Bessel bound of the frame. 
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The adjoint of the analysis operator is the synthesis operator which is given by 


T*ei = Lpi. 


Note that the matrix representation of the synthesis operator of a frame is the N x M matrix with 

the frame vectors as its columns. 


T* 


‘fl ^2 ■ ■ ■ 


In practice, we often work with the matrix representation of the synthesis operator with respect to the 
eigenbasis of the frame operator (as defined below). It will be shown later that the rows and columns of this 
matrix representation must satisfy very specific properties that proves useful in constructing frames. See 
Proposition 14.281 and Proposition 14.291 


Theorem 4.3. Let he a family of vectors in a Hilbert space H^. The following are equivalent: 

(1) {Ti}t=i a frame for M. 

(2) The operator T* is bounded, linear, and surjective. 

(3) The operator T bounded, linear, and injective. 

Moreover, {‘Pi}i£i is a Parseval frame if and only if the synthesis operator is a quotient map (that is, a 
partial isometry) if and only ifT*T = Id if and only if T is an isometry. 


Proof. (1) (2) is immediate by Proposition l4.2l and (2) (3) is immediate by Proposition l3.6l Proposition 

13.131 gives the moreover part. □ 


The frame operator for the frame is S' = T*T : — >■ given by 

C M \ M M 

(pi)e^ I = ipf)T*ei = '^{x, Ti)Ti- 

i=l ) i=l i=l 

A direct calculation, as given in Example l3.I0l yields 

M 

(4.2) (Sa;,x) = ^ |(a;,(^i)p. 

i=l 


Proposition 4.4. The frame operator of a frame is a positive, self-adjoint, and invertible operator 

on . Moreover, if A and B are frame hounds, then S satisfies the operator inequality 

A-Id<S <B-Id. 


Proof. Example 13.101 shows that it is positive and self-adjoint. We check the operator inequality: 

M 

{Ax,x) = A||x||^ < ^ |(x, = {Sx,x) < BWxW^ = {Bx,x) 

i^l 

for all X € Note that this also shows that S is invertible. □ 


The frame operator can be used to reconstruct vectors in the space using the computation 

X = S~^Sx 

= SS-^x 

M 

= '^{S~'^X,(pi)(pi 
i=l 
M 

i=l 


M / M 


Also, 
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= X. 


It follows that is a Parseval frame. Since S is invertible, the family is also a frame 

for called the canonical dual frame. See Subsection 14.21 for the definition and properties of dual 
frames. 

The following result is basically just a restatement of the definitions and known facts. 

Proposition 4.5. Let <1> = be a frame for with analysis operator T and frame operator S. The 

following are equivalent: 

(1) is an A-tight frame for H^. 

(2) S = A- Id. 

(3) For every x G 

1 “ 

X = 

f4J For every x G 

M 

(5) T/'/A is an isometry. 

Moreover, i/ $ is a Parseval frame then A = 1 above. 


Tight frames have the property that all of the eigenvalues of the frame operator coincide and are equal the 
frame bound. For an arbitrary frame, it turns out the smallest and largest eigenvalues of the frame operator 
are the optimal lower and upper frame bounds, respectively. 

Theorem 4.6. Suppose is a frame for with frame operator S with eigenvalues Ai > A 2 > • • • > 

Aat. Then Ai is the optimal upper frame bound and A^v is the optimal lower frame bound. 


Proof. Let be an orthonormal eigenbasis of the frame operator S with associated eigenvalues {Aj}^^ 

given in decreasing order. Now, given an x G H^, write 

N 

X = ^(x,ej)ej 


to obtain 


By Equation (14.2p . this gives that 


M 




2=1 


N 

Sx = ^\j{x,ej)ej. 
j=i 

N 

{Sx,x) = X {K{x,ei)ei,{x,ej)ej) 


N 


proving that Ai is an upper frame bound. To see that it is optimal, note 

M 

X = (5'ei,ei) = Ai. 


The lower bound is proven similarly. 


□ 


Another type of sequence that we often deal with are Riesz bases, which rids of the orthonormality 
assumption, but retains a unique composition. 
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Definition 4.7. A family of vectors in a Hilbert space is a Riesz basis if there are constants 

A, B > 0 so that for all families of scalars {ai}fLi we have 


N 




N 

2=1 


2 


N 

i=l 


The following gives an equivalent formulation, in particular, Riesz bases are precisely sequences of vectors 
that are images of orthonormal bases under an invertible map. It follows directly from the definitions. 

Proposition 4.8. Let 4> = he a family vectors in Then the following are equivalent. 

(1) $ is a Riesz basis for with Riesz bounds A and B. 

(2) For any orthonormal basis {ei}^^i for the operator F on given by Fci = (pi for all i = 

1,2, ■ ■ ■, N is an invertible operator with UPlP < B and > A. 

R follows that i/ is a Riesz basis with bounds A and B, then it is a frame with these same bounds. 


Next we see that applying an invertible operator to a frame still gives a frame. 

Proposition 4.9. Let $ = he a sequence of vectors in with analysis operator T and let F be a 

linear operator on Then the analysis operator of the sequence F^ = {Fipi}ff^ is given by 

Tf^ = TF*. 

Moreover, i/ is a frame for and F is invertible, then F^ is a also a frame for . 

Proof. For x G H^, 

TF^x={{x,Fip,)}^^^ = =rF*x. 

The moreover part follows from Theorem 14.31 □ 


Furthermore, if we apply an invertible operator to a frame, there is a specific form that the frame operator 
of the new frame must take. 

Proposition 4.10. Suppose $ = is a frame for with frame operator S and F is an invertible 

operator on Then the frame operator of the frame F^ = {F(pi}ff^ is the operator FSF*. 

Proof. This follows immediately from Proposition 14.91 and the definition. □ 

Corollary 13.331 concerning the trace formula for diagonalizable operators, has a corresponding result for 
Parseval frames. 

Proposition 4.11 (Trace formula for Parseval frames). Let 4> = {p>i}fLi be a parseval frame on and 
let F be a linear operator on . Then 

M 

Tr{F) = '^{F(pi,p>i). 

2=1 

Proof. If orthonormal basis for then by definition 

N 

Tr{F) = J2{Fei,ei). 

This along with the fact that is Parseval gives that 

N I M 

Tr{F) = XI ( 'PiFej,>Pi)Ti, ej 
i=i \i=l 
N M 

j=l i=l 
MIN 

= ^i^{g}i,ej)ej,F*g}, 

i=i \j=i 
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M 

M 


Definition 4.12. Two frames {^Pi}fLi and {V'ijilii in a Hilbert space are isomorphic frames if there 
exists a bounded, invertible operator L : —>■ so that LLpi = tpi for all 1 < i < M. We say they are 

unitarily isomorphic frames if L is a unitary operator. 

Proposition 4.13. Let d* = and T = {V'ililii be frames for with analysis operators Ti and T 2 

respectively. The following are equivalent: 

(1) ^ and T are isomorphic. 

(2) ran Ti = ran T 2 . 

(3) kerT* = kerr^. 

Moreover, in this case F = T2 CL*|i'anTi)~^ satisfies Fipi = tpi for all i = 1, 2, • • •, M. 

Proof. The equivalence of (2) and (3) follows by Proposition [XU 

(1) => (3): Let Fipi = tpi he a, well-defined invertible operator on Then by Proposition 14.91 we have 
that T 2 = TiF* and hence FTf = T^. Since F is invertible, (3) follows. 

(2) => (1): Let P be the orthogonal projection onto W = ranTi = ranr2- Then {Id — P) is an orthogonal 
projection onto = kerTf = kerT^ so that 

= T*e, = TfPe, + Tf{Id - P)e, = TfPe, 

and similarly ifi = T^Pci. The operators T* and T 2 both map W bijectively onto H^. Therefore, the 
operator F := Tf (Tf maps bijectively onto itself. Consequently, for alH = 1,2, • • •, M we have 

F^, = T;{Tf\w)-^TfPe, = T^Pe, = ^i. □ 

As a consequence of Proposition 14.101 we have: 

Theorem 4.14. Every frame (with frame operator S) is isomorphic to the Parseval frame . 

Proof. The frame operator of is S{S~^^'^)* = Id. □ 

As a consequence, only unitary operators can map Parseval frames to Parseval frames. 

Corollary 4.15. If two Parseval frames <1> = and T = {V'llfci isomorphic, then they are 

unitarily isomorphic. 

Proof. Since both frames have the identity as their frame operator, if F maps one Parseval frame to another 
and is invertible, then by Propositon 14.101 

Id = F{Id)F* = FF*. 

Since F*F is injective, F is a unitary operator by Proposition 13.131 □ 

We can always “move” one frame operator to another. 

Proposition 4.16. Let d* = and 4' = {4’i}tLi be frames for with frame operators Si and S 2 

respectively. Then there exists an invertible operator F on so that Si is the frame operator of the frame 
F-^ = {FiPi}fi^. 

Proof. If S is the frame operator of P'S, letting F = Si S 2 we have 

s = FS 2 F* = {sF^S 2 ^^^)S 2 iSl^'^S 2 ^^'^)* = Si. 


□ 
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4.2. Dual Frames. We begin with the definition. 

Definition 4.17. If $ = is a frame for a frame for is called a dual frame for 4) if 

M 

= X, for all X G 

i=l 

It follows that the canonical dual frame where S is the frame operator of 4>, is a dual frame. 

But there are many other dual frames in general. 

Proposition 4.18. Let 4) = ^ frames for with analysis operators Ti, T 2 

respectively. The following are equivalent: 

(1) 4* is a dual frame of 4>. 

(2) r*T2 = Id. 

Proof. Note that for any x G 

M 

TfT2X = Tf [((x,V'^))“i] = 

i=l 

The result is now immediate. □ 

Theorem 4.19. Suppose 4> = is a frame with analysis operator Ti and frame operator S. The 

class of all dual frames of $ are frames of the form := {S~^(pi + where if T 2 is the analysis 

operator o/T = then T*T2 = 0. That is, ranTi _L ranT2. 

Proof. Note that the analysis operator of {r]i}^i is + T 2 . Now, 

T*((T*)"^ + T 2 ) = Tf{Tf)-^ + T*T2 =Id + Q = Id. 

By Proposition 14.181 is a dual frame of 4). 

Conversely, if {?7i}^i is a dual frame for $, let ipi = rji — S~^ipi, for all i = 1,2, • • •, M. Then for all 
X G H^, 

M 

TfT2X = y^fx,'tpi)(pi 

i=l 

M 

= - S~^(pi)(p, 

i^l 

M M 

= S~^Lpi)Lpi 

i=l i=l 

= X — X = 0. 

This implies that for all x,y G H^, 

(Tix,T2y) = (x,r*T2y)=0, 

which is precisely ranTi T ranT2. □ 

Proposition 4.20. Let 4> = be a frame for with frame operator S. Then the only dual frame 

of ^ which is isomorphic to 4> is {S~^ipi}ffi. 

Proof. Let b® a dual frame for 4> and assume there is an invertible operator F so that "ipi = FS~^ipi 

for alH = 1, 2, • • •, M. Then, for every x G we have 

M 

F*x = S~^(pi)(pi 

i^l 

M 

2=1 
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M 

i=l 
= X. 

It follows that F* = Id and so F = Id. □ 

4.3. Redundancy. The main property of frames which makes them so useful in applied problems is their 
redundancy. That is, each vector in the space has infinitely many representations with respect to the 
frame but it also has one natural representation given by the frame coefficients. The role played by re¬ 
dundancy varies with specific applications. One important role is its robustness. That is, by spreading 
our information over a wider range of vectors, we are better able to sustain losses (called erasures in this 
setting) and still have accurate reconstruction. This shows up in internet coding (for transmission losses), 
distributed processing (where “sensors” are constantly fading out), modeling the brain (where memory cells 
are constantly dying out) and a host of other applications. Another advantage of spreading our information 
over a wider range is to mitigate the effects of noise in our signal or to make it prominent enough so it 
can be removed as in signal/image processing. A further upside of redundancy is in areas such as quantum 
tomography where we need classes of orthonormal bases which have “constant” interactions with one another 
or we need vectors to form a Parseval frame but have the absolute values of their inner products with all 
other vectors the same. In speech recognition, we need a vector to be determined by the absolute value 
of its frame coefficients. This is a very natural frame theory problem since this is impossible for a linearly 
independent set to achieve. Redundancy is a fundamental issue in this setting. 

Our next proposition shows the relationship between the frame elements and the frame bounds. 

Proposition 4.21. Let be a frame for with frame bounds A,B. Then we have ||</5i|p < B 

for all 1 < i < M, and if = B holds for some i, then tpi T span{(/9j}j^i. If ||v5i||^ < A, then 

Proof. If we replace x in the frame definition by (ft we see that 

The first part of the result is now immediate. For the second part, assume to the contrary that E = 
span {(pj}j^i is a proper subspace of H^. Replacing (pi in the above inequality by P^±ipi and using the left 
hand side of the inequality yields an immediate contradiction. □ 

As a particular case of Proposition I4.21| we have for a Parseval frame {pi}^i that WpiW^ < 1 for all i, 
and ||(/Ji|| = 1 for some i if and only if ipi T spanWe call {'Pi}iLi an exact frame if it ceases 
to be a frame when any one of its vectors is removed. If is an exact frame then {S~^(pi, ipj) = 

= 6ij (where S ij is the Kronecker delta) since {S' is now an orthonormal basis 

for H^. That is, {S~^(pi}ffi and {(pi}f£i form a biorthogonal system. Also, it follows that {ei}^^ is an 
orthonormal basis for if and only if it is an exact, Parseval frame. Another consequence of Proposition 
I4.21l is the following. 

Proposition 4.22. The removal of a vector from a frame leaves either a frame or an incomplete set. 

Proof. By Theorem 14.141 we may assume that is a Parseval frame. Now by Proposition 14.211 for 

any i, either ||(/3j|| = 1 and pi T spanor ||(^i|| < 1 and pi G spsm{ipj}jp,i. □ 

4.4. Minimal Moments. Since a frame is not independent (unless it is a Riesz basis) a vector in the space 
will have many representations relative to the frame besides the natural one given by the frame coefficients. 
However, the natural representation of a vector is the unique representation of minimal 1'2-norm as the 
following result of Duffin and Schaeffer [?5] shows. 

Theorem 4.23. Let $ = be a frame for a Hilbert space with frame operator S and x G H'^. If 

{bi}iLi is any sequence of scalars such that 

M 

a; = ^ biipi, 
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then 

(4.3) 


M 


M 


M 


XI 1^*1^ = XII+ X 1(5' ^x,ipi)-bi\^. 


2=1 


2=1 


2 = 1 


Proof. We have by assumption 

M M 

(pi)(pi = a; = y] 

2=1 2=1 

Therefore, the sequence {{S~^x,ipi) — S kerT* = [ranT]-^, where T is the analysis operator of $. 

Now, writing 

h = {S~^x, ipi) - (( 5 “^x, ip^) - bi) 


and noting that the sequence {(S' ^x,^pi)}f^-^ € ranT and therefore perpendicular to {(S ^x,(pi) — 
gives (14.31) . □ 


4.5. Orthogonal Projections and Naimark’s Theorem. A major advantage of frames over wavelets is 
that orthogonal projections take frames to frames but do not map wavelets to wavelets. 

Proposition 4.24. Let {^Pi}fLi he a frame for with frame bounds A,B, and let P be an orthogonal 
projection on H. Then {Pipi}^^ is a frame for P{H) with frame bounds A, B. In particular, an orthogonal 
projection of a orthonormal basis (or a Parseval frame) is a Parseval frame. 

Proof. For any x € P{H) we have 

M M M 

X = X = X 

2 = 1 2 = 1 2=1 

The result is now immediate. □ 


Proposition 14.241 gives that an orthogonal projection P applied an orthonormal basis {ei}ffi for 
leaves a Parseval frame {Pei}ff^ for PfR^). The converse of this is also true and is a result of Naimark 
(see [30] and Han and Larson ESI). 

Theorem 4.25 (Naimark’s Theorem). A seguence {ipi}^.^ is a Parseval frame for a Hilbert space if 
and only if there is a larger Hilbert space D and an orthonormal basis {ei}ffi for so that the 
orthogonal projection P ofR^ onto satisfies Pci = (fi for all i = 1,2, - , M. 

Proof. The “if” part follows from Proposition 14.241 For the “only if” part, note that if {<Pi}f£i is a Parseval 
for H^, then the synthesis operator T* : —>■ is a partial isometry. Let {efjffi be an orthonormal 

basis for for which T*ei = <pi for alH = 1, 2, • • •, M. Since the analysis operator T is an isometry we can 
identify with T(IHI^). Now let and let P be the orthogonal projection of onto 

Then for alH = 1, 2, • • •, M and all y = Tx € r(IHI^) we have 

{Tx,Pei) = {PTx,ei) = {Tx,ei) = {x,T*ei) = {x,(pi) = {Tx,Tipi). 

It follows that Pci = Tipi, and the result follows from the association of with r(IHI^). □ 

Definition 4.26. The standard A^-simplex (or regular A^-gon) is the subset of given by unit norm 

{Ti}f=i which are equiangular. 

It follows from Proposition 14.241 


Corollary 4.27. A regular simplex is an eguiangular tight frame. 


Proof. Given a regular Af-simplex, it can be realized by letting be an orthonormal basis for K.'^ and 

letting 

N 


X = SiCi, for any Si = 1, for i = 1, 2, • • •, N. 

i=l 

Now let P be the orthogonal projection onto the span of x, which is given by: 


Py 


1 

N 


N 


X 
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Then the TV-simplex is a scaling by \/\\{Id — P)ei\\ of {{Id — which is TV-vectors in an TV — 1- 

dimensional Hilbert space and is a Parseval frame by Proposition 14.241 □ 

4.6. Frame Representations. Another important property of frames is given in the next proposition. 

Proposition 4.28. Let $ = he a sequence of vectors in let be an orthonormal basis 

for and let positive real numbers. The following are equivalent: 

(1) ^ is a frame for with frame operator S having eigenvectors {ej}^^i and respective eigenvalues 

(2) The following hold: 

(a) If for all j = 1,2,---,TV, 

fij := {{(fii,ej),{ip2,ej),--- ATM,ej)), 

then for all 1 < j ^ k < N we have 

i'fpjAk) = 0 . 

(b) For all j = 1,2, - N we have \\tjjj ||| = Xj. 

Proof. If is a frame for with frame operator S having eigenvectors {ej}jLi and respective 

eigenvalues then for all j = 1, 2, • • •, TV we have 

M 

'y Ti)Ti — AjCj. 

i=l 

Hence, for 1 < j ^ fc < TV we have 

M M 

{tpj,tpk) = '^{(pi,ej){(pi,ek) = '^{ej,(pi){ipi,ek) = {Xjej,ek) = 0 . 
i—1 i—1 

Similarly, 

IIV'jll2 ~ (AjSjjej) = Xj. D 

This gives some important properties of the matrix representation of the synthesis operator. As stated 
before, these criterion are often used in constructing frames with a given synthesis operator. 

Proposition 4.29. If [ipi }Ai is a frame for and T* = is the synthesis matrix with respect 

to the eigenvectors of the frame operator, then the following hold. 

(1) The rows of T* are orthogonal. 

(2) The square sum of the columns are the square norm of the frame vectors. 

(3) The square sum of the rows are the eigenvalues of the frame operator. 

5. Constants Related to Frames 
Let t’e a frame for with frame operator S. 

General Frame: The sum of the eigenvalues of S equals the sum of the squares of the lengths of the frame 
vectors: 

N M 

j=i i=i 

Equal Norm Frame: For an equal norm frame in which ||(/?i|| = c holds for all T = 1, 2, • • •, TVf we have 

N M 

j=i i=i 
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Tight Frame: Since tightness means A = we have 

M 

\ {x,(pi)\‘^ = A||x||^, for all X e . 

We have that S = A - In and thus the sum of the eigenvalues becomes: 

N M 

N-A=j2x, = j2\\^,r. 

j=i i=i 

Parseval Frame: If the frame is Parseval, then A = B = 1 and so 

M 

^ Kx, = ||a:|p, for all a: € Hat. 
2=1 


We have that S = Id and 


N M 

1=1 i=l 

Equal Norm Tight Frame: For an equal norm A-tight frame in which ||i^i|| = c holds for all z = 1,2, • • •, M 
we have 


N M 

N-A = Y^X,=Y^\\^,f=M-c\ 

j=i i=i 


Hence A = M ■ /N and thus 


X! , for all X £ 


Equal Norm Parseval Frame: For an equal norm Parseval frame we have 

M M 

n = Y.x,=Y,M^ = c^m. 

i=i i=l 

6. Constructing Finite Frames 

For applications, we need to construct finite frames with extra properties such as: 

(1) Prescribing in advance the norms of the frame vectors. (See for example pSl 155115S] 1. 

(2) Constructing equiangular frames. That is, frames for which there is a constant c > 0 and 

= c, foralH^j. 

(See for example [37l IHTl [76l [77] 1. 

(3) Frames for which the operator 

±x i-A {I (a;, I , is one-to-one. 

(See for example [51 [TT]1. 

For a good introduction to constructive methods for frames see [55] 
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6.1. Finding Parseval Frames. There is a unique way to get Parseval frames of M vectors in H^. Take 
a M X M unitary matrix U = (ay)fj=i- Take the submatrix 

T/ ^ 

V — 

The rows of V form a parseval frame for since these vectors are just the rows of the matrix U (which 
are an orthonormal basis for projected onto and so form a Parseval frame. The converse to this is 
also true - and follows directly from Naimark’s Theorem (Theorem 14.251) . 

6.2. Adding vectors to a frame to make it tight. Every finite frame for Hv can be turned into a tight 
frame with the addition of at most N — 1-vectors. 


Proposition 6.1. If {<Pi}f£i is a frame for then there are vectors {'^ 3)^=2 

is a tight frame. 

Proof. Let S be the frame operator for the frame with eigenvectors and respective eigenvalues 

that satisfy Ai > A2 > • • • > Xn- We define ipj for j = 2, 3, • • •, A by 

ipj = \/Ai — Xj Cj. 

This family {(pi}f£i U {ipj}f =2 is a Ai-tight frame. □ 

6.3. Majorization. One of the main constructive methods for frames is due to Casazza and Leon [35l 
[36] . They gave a construction for the important results of Benedetto and Fickus [8] and Casazza, Fickus, 
Kovacevic, Leon, Tremain |29) . 


Theorem 6.2. |29) Fix N < M and ai > 02 > • • • > om > 0. The following are equivalent: 

(1) There is a tight frame for satisfying ||</5j|| = Oi, for all i = 1, 2, • • •, M. 

(2) For all 1 < n < N we have 

2 
af 


(3) We have 


(4) If 


then 


E m 

i=n+l ' 


N — n 


M 


> Nal 


i=l 


A = 


N 


V at 

Xoi < 1, for all i = 1, 2, • • •, M. 


This result was generalized by Casazza and Leon [35] to: 

Theorem 6.3. Let S be a positive self-adjoint operator on and let Xi > X 2 >■■■ > Xn > 0 be the 
eigenvalues of S. Fix M > N and real numbers oi > 02 > • • • > om > 0. The following are equivalent: 

(1) There is a frame {ififffi for with frame operator S satisfying ||i^i|| = Oi for all i = 1, 2, • • •, M. 

(2) For every 1 < k < N we have 

k k 

1=1 1=1 

and 

M N 

i=i 3=1 

Theorem 16.31 21 is the so called majorization of one sequence over another. The next result follows 
readily from the above results. 

Corollary 6.4. Let S be a positive self-adjoint operator on H^. For any M > N there is an equal norm 
sequence {<Pi}ffi in which has S as its frame operator. 
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Proof. Let Ai > A 2 > ... Ajv > 0 be the eigenvalues of S and let 

N 


( 6 . 1 ) 


1 


a 




1=1 


Now we check condition (2) of Theorem 16.31 to see that there is a sequence in with ||(^i|| = a for 

all i = 1, 2, • • •, M. That is, we check the condition with oi = 02 = • • • om = To check the equality in 
Theorem 16.31 21. note that by Equation (16.11) we have 

M N 

( 6 . 2 ) = Ma^ = 

For the first inequality with A: = 1 in Theorem l6.3f 2L we note that by Equation f|6.ip we have that 

N ^ N 




1 “ M - N 

i=l i=l 

So our inequality holds for k = 1. Suppose there is an 1 < fc < TV for which this inequality fails and k is the 
first time this fails. So, 


while 

It follows that 
Hence, 


= ka^ > 


2=1 
.2 ^2 


2 = 1 


o^k+i = * * * = ^iv = ^ > A/c > A/c+i > • • • > Aat. 


M 


N 


2=1 i=k-\- 

k N 


a, 


2 = 1 2=1 2 = /c+l 

k N 

2=1 2=fc + l 

k N 

> E + E 

2=1 2=fc + l 

N 


- 


i=l 


But this contradicts Equation (16.21) . 


□ 


There was a recent significant advance on this subject due to due to Cahill/Fickus/Mixon/Poteet/Strawn 
[mn] where they give an algorithm for constructing all self-adjoint matrices with prescribed spectrum and 
diagonal and all finite frames with prescribed spectrum and diagonal. This work technically contains the 
solution to many of our frame questions. That is, if we could carry out their construction with an additional 
restriction on it (e.g. requiring “equiangular” - see Subsection I10.1|) then we could construct equiangular 
tight frames. 


6.4. Spectral Tetris. Another significant advance for frame theory came when Spectral Tetris was in¬ 
troduced by Casazza/Fickus/Mixon/Wang/Zhou ^7}. This is now a massive subject and we refer the reader 
to a comprehensive survey of Casazza/Woodland [39]. We will just give an illustrative example here. 

Before we begin our example, let us go over a few necessary facts for construction. Recall, that in order 
to construct an M-element unit norm tight frame (UNTF) in we will construct a.n N x M synthesis 
matrix having the following properties: 

(1) The columns square sum to one, to obtain unit norm vectors. 




FRAMES AND THEIR APPLICATIONS 


27 


(2) The rows are orthogonal, which is equivalent to the frame operator, S, being a diagonal N x N 
matrix. 

(3) The rows have constant norm, to obtain tightness, meaning that S = A ■ Id for some constant A. 
Remark 6.5. Since we will be constructing M-element UNTFs in recall that the frame bound will be 


Also, before the construction of a frame is possible, we must first ensure that such a frame exists by 
checking that the spectrum of the frame majorizes the square vector norms of the frame. However, this is 
not the only constraint. For Spectral Tetris to work, we also require that the frame has redundancy of at 
least 2, that is M > 2N, where M is the number of frame elements and N is the dimension of the Hilbert 
space. For a UNTF, since our unique eigenvalue is ■^, we see that this is equivalent to the requirement that 
the eigenvalue of the frame is greater than or equal to 2. 

The main idea of Spectral Tetris is to iteratively construct a synthesis matrix, T*, for a UNTF one to 
two vectors at a time, which satishes properties (1) and (2) at each step and gets closer to and eventually 
satisfies property (3) when complete. When it is necessary to build two vectors at a time throughout the 
Spectral Tetris process, we will utilize the following key 2x2 matrix as a building block for our construction. 

Spectral Tetris relies on the existence of 2 x 2 matrices A (a;), for given 0 < a; < 2, such that: 

(1) the columns of A (x) square sum to 1, 

(2) A (x) has orthogonal rows, 

(3) the square sum of the first row is x. 

These properties combined are equivalent to 


A (x) A* (x) 


X 0 
0 2-a: 


A matrix which satisfies these properties and which is used as a building block in Spectral Tetris is: 


A (a:) 


We are now ready to give the example. 



Example 6.6. We would like to use Spectral Tetris to construct a sparse, unit norm, tight frame with 11 
elements in H^, so our tight frame bound will be 

To do this we will create a 4 x 11 matrix T*, which satisfies the following conditions: 

(1) The columns square sum to 1. 

(2) T* has orthogonal rows. 

(3) The rows square sum to 

(4) S = T*T =^-Id. 

Note that (4) follows if (1), (2) and (3) are all satisfied. Also notice that the sequence of eigenvalues 
= {x’X’X’xi majorizes the sequence of square norms = {1,1,1,1,1,1,1,1,1,1,1}, 

which, in general, is necessary for such a frame to exist. 

Define tij to be the entry in the row and column of T*. With an empty 4x11 matrix, we start 
at ti.i and work our way left to right to fill out the matrix. By requirement (1), we need the square sum of 
column one to be 1 and by requirement (2) we need the square sum of row one to be ^ > 1. Hence, we will 
start by being greedy and put the maximum weight of 1 in ti.i. This forces the rest of the entries in column 
1 to be zero, from requirement (1). We get: 



Next, since row one needs to square sum to by (3), and we only have a total weight of 1 in row one, 
then we need to add ^ — 1 = | = 1 + |>1 more weight to row one. So we will again be greedy and add 
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another 1 in ti^ 2 - This forces the rest of the entries in column 2 to be zero, by (1). Also note that we have 
a total square sum of 2 in row one. We get: 




1 1 
0 0 
0 0 
0 0 


In order to have a total square sum of ^ in the first row, we need to add a total of^ — 2 = |<1 
more weight. If the remaining unknown entries are chosen so that T* has orthogonal rows, then S will be 
a diagonal matrix. Currently, the diagonal entries of S are mostly unknowns, having the form {2+?, •, •, •}. 
Therefore we need a way to add | more weight in the first row without compromising the orthogonality of 

the rows of T* nor the normality of its columns. That is, if we get “greedy” and try to add to position 
then the rest of row one must be zero, yielding: 


T* 


1 1 
0 0 
0 0 
0 0 



0 0 0 0 


0 0 


In order for column three to square sum to one, at least one of the entries ^ 2 , 3 , ^ 3^3 or ^ 4^3 is non-zero. But 
then, it is impossible for the rows to be orthogonal and thus we cannot proceed. Hence, we need to instead 
add two columns of information in attempts to satisfy these conditions. The key idea is to utilize our 2x2 
building block, A (x), as defined at (a). 

We define the third and fourth columns of T* according to such a matrix A(x), where x = ^ — 2 = |. 
Notice that by doing this, column three and column four now square sum to one within the first two rows, 
hence the rest of the unknown entries in these two columns will be zero. We get: 


T* 


1 1 

0 0 
0 0 
0 0 




The diagonal entries of S are now {^, |+?, •, •}. The first row of T*, and equivalently the first diagonal 
entry of S, now have sufficient weight and so its remaining entries are set to zero. The second row, however, 


is currently falling short by ^ f -f (--^ 1 ) 


4 ^ 4 ■ 


Since 1 -f | > 1, 


we can be greedy 


and add a weight of 1 in t 2 , 5 - Hence, column five becomes 62 - Next, with a weight of | < 1 left to add to 
row two we utilize our 2x2 building block A (x), with a; = |. Adding this 2x2 block in columns six and 
seven yields sufficient weight in these columns and hence we finish these two columns with zeros. We get: 


T* 


11 ^ 1^10 0 0 0000 
0 0 \/| -\/l 1 \/i \/§ 0 0 0 0 

000 0 0 ./| -a/I . • • • 

0 0 0 0 0 0 0 • • • • 


The diagonal entries of T* are now where the third diagonal entry, and equivalently the 

third row, are falling short by^ — | = | = 1-|-|;. Since 1 + -j > 1, then we take the eighth column of T* to 
be 63 . We will complete our matrix following these same strategies, by letting the ninth and tenth columns 
arise from A (j), and making the final column 64 , yielding the desired UNTF: 
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11 ^ 1^100 0 00 0 0 
0 0 \/f -\/f 1 \/i \/i 0 0 0 0 

0 0 0 0 0 ^ 1 ^ ^ 0 

000 0 00 ooy^ -\Jl 1 


In this construction, column vectors are either introduced one at a time, such as columns 1, 2, 5,8, and 11, 
or in pairs, such as columns {3,4}, {6, 7}, and {9,10}. Each singleton contributes a value of 1 to a particular 
diagonal entry of S, while each pair spreads two units of weight over two entries. Overall, we have formed a 
flat spectrum, {^, ^}, from blocks of area one or two. This construction is reminiscent of the game 

Tetris, as we fill in blocks of mixed area to obtain a flat spectrum. 


7. Gramian Operators 

If {</5z}^i is a frame for with analysis operator T, the Gramian operator is defined as 


G := TT*, 


which has matrix representation 

called the Gramian matrix. Since we know T*T and TT* have the same non-zero eigenvalues, we have: 

Proposition 7.1. Let {^Pi}fLi be a frame for with frame bounds A,B and frame operator S. The 
Gramian operator has the same non-zero eigenvalues as S. That is, the largest eigenvalue of G is less than 
or equal to B and the smallest non-zero eigenvalue is greater than or equal to A. 

Theorem 7.2. If {(pi}ff^ is a Parseval frame with analysis operator T, then the Gramian operator is an 
orthogonal projection. 

Proof. It is clear that TT* is self-adjoint and 


Corollary 7.3. Let $ = he vectors in H^. The Gramian o/$ is invertible if and only */$ is a 

Riesz basis (that is, when M = N). 

Proof. If G = TT* is invertible, by Proposition 17.11 T*T is invertible. Hence, is a frame for H^. 

Also, T* is one-to-one, and further T* is bounded, linear and onto. Hence, it is an isomorphism. 

If is a Riesz basis then T* is an isomorphism and we have that T* is invertible and so G = TT* 

is invertible. □ 


Proposition 7.4. Let F = [aij]fd^i be a positive, self-adjoint matrix (operator) on with dimker F = 
M - N. Then {F^/‘^ei})(i^ spans an N-dimensional space and 

= {Fei,ej) = a^. 

Hence, F is the Gramian matrix for the vectors Moreover, 

\\F^'^e,f = au, 

and so if an = 1 for all i = 1,2, - ■■ ,M then {F^/^eiffL^ is a unit norm family. 
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8. Fusion Frames 

A number of new applications have emerged which cannot be modeled naturally by one single frame 
system. Generally they share a common property that requires distributed processing. Furthermore, we are 
often overwhelmed by a deluge of data assigned to one single frame system, which becomes simply too large 
to be handled numerically. In these cases it would be highly beneficial to split a large frame system into a 
set of (overlapping) much smaller systems, and to process locally within each sub-system effectively. 

A distributed frame theory for a set of local frame systems is therefore in demand. A variety of applications 
require distributed processing. Among them there are, for instance, wireless sensor networks [62], geophones 
in geophysics measurements and studies [43], and the physiological structure of visual and hearing systems 
m- To understand the nature, the constraints, and related problems of these applications, let us elaborate 
a bit further on the example of wireless sensor networks. 

In wireless sensor networks, sensors of limited capacity and power are spread in an area sometimes as 
large as an entire forest to measure the temperature, sound, vibration, pressure, motion, and/or pollutants. 
In some applications, wireless sensors are placed in a geographical area to detect and characterize chemical, 
biological, radiological, and nuclear material. Such a sensor system is typically redundant, and there is 
no orthogonality among sensors, therefore each sensor functions as a frame element in the system. Due 
to practical and cost reasons, most sensors employed in such applications have severe constraints in their 
processing power and transmission bandwidth. They often have strictly metered power supply as well. 
Consequently, a typical large sensor network necessarily divides the network into redundant sub-networks 
- forming a set of subspaces. The primary goal is to have local measurements transmitted to a local sub¬ 
station within a subspace for a subspace combining. An entire sensor system in such applications could 
have a number of such local processing centers. They function as relay stations, and have the gathered 
information further submitted to a central processing station for hnal assembly. 

In such applications, distributed/local processing is built in the problem formulation. A staged processing 
structure is prescribed. We will have to be able to process the information stage by stage from local 
information and to eventually fuse them together at the central station. We see therefore that a mechanism 
of coherently collecting sub-station/subspace information is required. 

Also, due to the often unpredictable nature of geographical factors, certain local sensor systems are less 
reliable than others. While facing the task of combining local subspace information coherently, one has 
also to consider weighting the more reliable sets of substation information more than suspected less reliable 
ones. Consequently, the coherent combination mechanism we just saw as necessary often requires a weighted 
structure as well. This all leads naturally to what is called a fusion frame. 

Definition 8.1. Let / be a countable index set, let {Wi}f£i be a family of closed subspaces in and let 
{ui}iLi be a family of weights, i.e. Vi > 0 for all i £ I. Then is a fusion frame, if there exist 

constants 0 < C < D < oo such that 

M 

(8.1) \\Pwi{x)f < D\\xf for all CO G H^, 

i=l 

where Pwi is the orthogonal projection onto the subspace Wi. We call C and D the fusion frame bounds. 
The family {{Wi,Vi)}f£i is called a C-tight fusion frame, if in (|8.1I1 the constants C and D can be chosen 
so that C = D, a. Parseval fusion frame provided that C = D = 1, and an orthonormal fusion basis if 
= 0^1 If possesses an upper fusion frame bound, but not necessarily a lower bound, 

we call it a Bessel fusion sequence with Bessel fusion bound D. 

Often it will become essential to consider a fusion frame together with a set of local frames for its subspaces. 
In this case we speak of a fusion frame system. 

Definition 8.2. Let {(Wi,Vi)}f£i be a fusion frame for H^, and let the sequence of vectors {xijjjLi be a 
frame for Wi for each 1 < i < M. Then we call {(Wi,Vi, a fusion frame system for H'^. 

The constants, C and D, are the associated fusion frame bounds if they are the fusion frame bounds for 
{{Wi,Vi)}^i, and A and B are the local frame bounds if these are the common frame bounds for the 
local frames {^ij}jLi foi' each 1 < i < M. A collection of dual frames, {4’ij}jLi for each I < i < M, 
associated with the local frames will be called local dual frames. 
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To provide a quick inside-look at some intriguing relations between properties of the associated fusion 
frame and the sequence consisting of all local frame vectors, we present the following theorem from m that 
provides a link between local and global properties. 

Theorem 8.3. [311 Thm. 3.2] For each I < i < M, let Vi > 0, let Wi he a closed subspace of 
and let {pijfjLi be a frame for Wi with frame bounds Ai and Bi. Suppose that 0 < A = infi<i<M^i < 
sup 2 <j<Mi?i = B < oo. Then the following conditions are equivalent. 

(1) {(Wi, Vi)}ffi is a fusion frame for H^. 

(2) {viPijYjS^i^i is a frame for . 

In particular, if {(Wi, iij, is a fusion frame system for with fusion frame bounds C and 

D, then {viipij}jll.^^_i is a frame for with frame bounds AC andBD. Conversely, if {viipij}j2^^^i is 
a frame for with frame bounds C and D, then {(Wi,Vi, {Tij}'jLi)}iLi is a fusion frame system for 
with fusion frame bounds ^ and ^. 

Tight frames play a vital role in frame theory due to the fact that they provide easy reconstruction 
formulas. Tight fusion frames will turn out to be particularly useful for distributed reconstruction as well. 
Notice, that the previous theorem also implies that {(Wi,Vi)}ffi is a C-tight fusion frame for if and 
only if {vifij}jil^j^^i is a C-tight frame for H^. 

The following result from |33j proves that the fusion frame bound C of a C-tight fusion frame can be 
interpreted as the redundancy of this fusion frame. 


Proposition 8.4. If {{Wi,Vi)}ffi is a C-tight fusion frame for , then 

N 

Let W = {(Wi,Vi)}ffi be a fusion frame for H^. In order to map a signal to the representation space, 
i.e., to analyze it, the fusion analysis operator Tyv is employed, which is defined by 


Tw ■■ 


uN 


' M \ 

^©Wij with Tw{x) = {v^Pwiix)}^^■ 

, i=l / fo 


It can easily be shown that the fusion synthesis operator T^, which is defined to be the adjoint operator 
of the analysis operator, is given by 


M 


with 


V J £2 

M / M \ 

Tw(x) = ^ ViXi, where x = {xi}fi^ G I ^ ®Wi j . 

\ i=l / 


The fusion frame operator S'yy for W is defined by 

Sw{x) = T^Tw(x) =y^^ViPwi(x). 


i€l 


Interestingly, a fusion frame operator exhibits properties similar to a frame operator concerning invertibil- 
ity. In fact, if {(Wi, Vi)}ffi is a fusion frame for with fusion frame bounds C and D, then the associated 
fusion frame operator Sw is positive and invertible on and 


(8.2) C ■ Id< Sw < D ■ Id. 

We refer the reader to m Prop. 3.16] for details. 

There has been a significant amount of recent work on fusion frames. This topic now has its own website 
and we recommend visiting it for the latest developments on fusion frames, distributed processing and sensor 
networks. 


http://www.fusionframe.org/ 
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But also visit the Frame Research Center Website: 


http://www.framerc.org/ 


9. Infinite Dimensional Hilbert Spaces 
We work with two standard infinite dimensional Hilbert Spaces. 


9.1. Hilbert Spaces of Sequences. We being with the definition. 

Definition 9.1. We define £2 by: 

00 

{x = {a^}“i : ||a:|| := ^ |aip < 00.} 

i^l 

The inner product of x = and y = is given by 

00 

{x,y) =y^^aibi. 

The space £2 has a natural orthonormal basis {ei}^i where 

where the 1 is in the i‘^-coordinate. Most of the results on finite dimensional Hilbert spaces carry over here. 
The one major exception is that operators here may not have eigenvalues or be diagonalizable. We give an 
example in the next subsection. But all of the “identities” hold here. Another difference is the notion of 

linear independence. 


Definition 9.2. A family of vectors {xi}'^^ in £2 is linearly independent if for every finite subset I C N 
and any scalars we have 

QiXi = 0 => Oi = 0, for all i £ /. 
iei 

The family is w-independent if for any family of scalars satisfying have 

00 

UiXi = 0 => Oi = 0 for all* = 1 , 2 , • • •. 

i=l 


An orthonormal basis {ei}^^ is clearly w-independent. But, linearly independent vectors may not be 
w-independent. For example, if we let 

Xi = Ci I = 1, 2, • • • , 

it is easily checked that this family is finitely linearly independent. But, 



i=l 


and so this family is not w-independent. 


9.2. Hilbert Spaces of Functions. We define a Hilbert space of functions: 
Definition 9.3. If A C K (or C) we define 

L^A) = |/ : A ^ R (or C) : ||/f := < ooj. 

The inner product oi f,g G (A) is 

if, 9) = J^f{t)g{t)dt. 
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The two cases we work with the most are T^([0,1]) and T^(R). 

The space T^([0,1]) has a natural orthonormal basis given by the complex exponentials: 

{e jnGZ- 

If we choose A C [0,1], the orthogonal projection of L^{[0, 1]) onto L^{A) satisfies: 


This family of vectors is a Parseval frame (since it is the image of an orthonormal basis under an orthog¬ 
onal projection) called the Fourier frame on A. Recently, Marcus/Spielman/Srivastava [69] solved the 
Feichtinger Conjecture for this class of frames (See subsection 110.611 . 

To get a flavor of things that don’t go so nicely in the infinite dimensional setting, we note that there are 
positive, self-adjoint, invertible operators on infinite dimensional Hilbert spaces which have no eigenvectors. 
For example, consider the operator S : L^([0,1]) —?► -b^([0,1]) defined by 

S{f){x) := {l+x)f{x). 

For any / S T^[0,1] we have: 

{f,Sf)=[ {l+x)f{x)dx> [ f{x)dx = \\f\\'^. 

Jo Jo 

So /S' is a positive, self-adjoint, invertible operator. However, in order for Sf = Xf we would need to have 


(1 -I- x)f{x) = Xf{x) almost everywhere on [0,1]. 


This is clearly impossible unless / = 0, so S' has no eigenvectors. 


10. Major Open Problems in Frame Theory 

In this section we look at some of the major open problems in Frame Theory. 

10.1. Equiangular Frames. One of the simplest stated yet deepest problems in mathematics is the equian¬ 
gular line problem. 

Problem 10.1. How many equiangular lines can be drawn through the origin in or C^? 

The easiest way to describe equiangular lines is to put a unit norm vector starting at the origin on each 
line, say and the lines are equiangular if there is a constant 0 < c < 1 so that 

= c, for all i ^ j. 

These inner products represent the cosine of the acute angle between the lines. The problem of constructing 
any number (especially, the maximal number) of equiangular lines in is one of the most elementary and 
at the same time one of the most difficult problems in mathematics. After sixty years of research, we do 
not know the answer for all dimensions < 20 in either the real or complex case. This line of research was 
started in 1948 by Hanntjes |58| in the setting of elliptic geometry where he identified the maximal number 
of equiangular lines in for n = 2,3. Later, Van Lint and Seidel [55] classified the largest number of 
equiangular lines in for dimensions N < 7 and at the same time emphasized the relations to discrete 
mathematics. In 1973, Lemmens and Seidel [66] made a comprehensive study of real equiangular line sets 
which is still today a fundamental piece of work. Gerzon |66| gave an upper bound for the maximal number 
of equiangular lines in R^: 

Theorem 10.2 (Gerzon). If we have M equiangular lines in R^ then 

2 

It is known that we cannot reach this maximum in most cases. It is also known that the maximal number 
of equiangular lines in is less than or equal to iV^. It is believed that this number of lines exists in 
for all N but until now a positive answer does not exist for all N < 20. 

Also, P. Neumann [66] produced a fundamental result in the area: 

Theorem 10.3 (P. Neumann). IfM.^ has M equiangular lines at angle 1/a and M > 2N, then a is an odd 
integer. 





34 


P.G. CASAZZA AND R.G. LYNCH 


Finally, there is a lower bound on the angle formed by equiangular line sets. 

Theorem 10.4. If{‘fm}m=i ** ® set of norm one vectors in then 

(10.1) max|((/?i,V?j)| > 

Moreover, we have equality if and only if {<Pi}f£i is an equiangular tight frame and in this case the tight 
frame hound is 


I M-N 
N{M - 1) ■ 


This inequality goes back to Welch m- Strohmer and Heath m and Holmes and Paulsen m give more 
direct arguments which also yields the “moreover” part. For some reason, in the literature there is a further 
assumption added to the “moreover” part of Theorem 110.41 that the vectors span R^. This assumption is 
not necessary. That is, equality in inequality IIP. II already implies that the vectors span the space [37]. 


Equiangular Tight Frames; 

Good references for real eqiuangular frames are [371 ini [HITT]. A unit norm frame with the property 
that there is a constant c so that 

\{ip^,(pj)\ = c, foralH^j, 

is called an equiangular frame at angle c. Equiangular tight frames first appeared in discrete geometry 
[68] but today (especially the complex case) have applications in signal processing, communications, coding 
theory and more [STIITS]. A detailed study of this class of frames was initiated by Strohmer and Heath 
m and Holmes and Paulsen m- Holmes and Paulsen [61] showed that equiangular tight frames give 
error correction codes that are robust against two erasures. Bodmann and Paulsen m analyzed arbitrary 
numbers of erasures for equiangular tight frames. Recently, Bodmann, Casazza, Edidin and Balan m 
showed that equiangular tight frames are useful for signal reconstruction when all phase information is lost. 
Recently, Sustik, Tropp, Dhillon and Heath m made an important advance on this subject (and on the 
complex version). Other applications include the construction of capacity achieving signature sequences for 
multiuser communication systems in wireless communication theory [79] . The tightness condition allows 
equiangular tight frames to achiece the capacity of a Gaussian channel and their equiangularity allows 
them to satisfy an interference invariance property. Equiangular tight frames potentially have many more 
practical and theoretical applications. Unfortunately, we know very few of them and so their usefulness is 
largely untapped. 

The main problem: 


Problem 10.5. Classify all equiangular tight frames, or find large classes of them. 

Fickus/Jasper/Mixon gave a large class of Kirkman equiangular tight frames and used them in 
coding theory. 


Theorem 10.6. The following are equivalent: 

(1) The space R^ has an equiangular tight frame with M elements at angle 1/a. 

(2) We have 


M = 


(a^ - 1)A^ 
a‘^-N 


and there exist M equiangular lines in R'^ at angle 1/a. 


Moreover, in this case we have: 

(a) a< N -2. 

(b) N = a if and only if M = N + 1. 

(c) N = — 2 if and only if M = . 

(d) M = 2N if and only if 


o? = 2N — 1 = + 6^, a,b integers. 


If M N + 1,2N then: 

(e) a is an odd integer. 

(f) M is even. 
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(g) a divides M-1. 

(h) P = is the angle for the complementary equiangular tight frame. 

10.2. The Scaling Problem. The scaling problem is one of the deepest problems in frame theory. 

Problem 10.7 (Scaling Problem). Classify the frames for so that there are scalars {ai}^^ for 

which {aiLpi\^i is a Parseval frame? Give an algorithm for finding {ai}fLi. 

This is really a special case of an even deeper problem. 

Problem 10.8. Given a frame {<Pi}^i for find the scalars {ai}^^ so that {ai<pi\fLi has the minimal 
condition nnmber with respect to all snch scalings. 

For recent results on the scaling problem see Ghen/Kutyniok/Okoudjou/ Philipp/Wang [40], Gahill/Chen 
m and Kutyniok/Okoudjon/Philipp/Tuley [65] . 


10.3. Sparse Orthonormal Bases for Subspaces. We will look at two questions concerning the con¬ 
struction of sparse orthonormal bases. 

Definition 10.9. Given a vector x = (oi, 02 , • • •, a^v) G we let 

Ikllo = |{1 < I < : a* yf 0}. 


A natnral question in Hilbert space theory is: 

Problem 10.10. Given a Hilbert space with orthonormal basis {ei}A ^ ^ dimensional snbspace 

W, find the sparsest orthonormal basis for W with respect to That is, find a orthonormal basis 

{9i}f=i for so that 

K 

llffilloi is a minimum with respect to all orthonormal bases for W. 

i=l 


Sparse Gram-Schmidt Orthogonalization: 

There is a basic notion for turning a linearly independent set into an orthonormal set with the same 
partial spans: Gram-Schmidt Orthogonalization. Given a set of linearly independent vectors in H^, 

first let 


ei = 


W^i 


Assnme we have constructed ^ satisfying: 

(1) is orthonormal. 

(2) We have 


span Ci = span (fi, for all j = 1, 2, • • •, AT. 


We then let 


and let 


N 


'tpK+i = g>K+i — y^(v?A'+i, ej)ej 


gk+i = 


i=l 

'f’K+l 


Hk+iW 

If we have a fixed basis {gi}fLi for H^, we can compute 

K 

||ei||o with respect to the basis {gi}^i. 


i=l 


But this sum is different for different orderings of the original vectors Related to Problem IIP. 101 we 

have: 


Problem 10.11. What is the correct ordering of so that Gram-Schmidt Orthogonalization produces 

the sparsest orthonormal sequence with respect to all possible orderings? 
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10.4. The Paulsen Problem. To state the Paulsen Problem, we need some definitions. 

Definition 10.12. A frame for with frame operator S is said to be e-nearly equal norm if 

(1 - < (1 + e)^, for alH = 1, 2, • • •, M, 

and it is er-nearly Parseval if 

(1 — e) • Id < S' < (1 + e) • Id. 

Definition 10.13. The distance between two frames $ = and 4' = is given by: 

M 

i=l 

Because we did not take the square-root on the right-hand-side of the above inequality, the function d is 
not really a distance function. 

The Paulsen Problem now states: 

Problem 10.14. How close in terms of d is an e-nearly equal norm and e-nearly Parseval frame to an equal 
norm Parseval frame? 

The importance of this problem is that we have algorithms for finding frames which are equal norm and 
nearly Parseval. But we do not know that these are actually close to any equal norm Parseval frame. 

The closest equal norm frame to a frame is known and the closest Parseval frame to a frame is known: 
The closest equal norm frame to a frame is 

\ where C := 

If $ = {<fi}fLi is a frame with frame operator S, the closest Parseval frame to 4> is the canonical Parseval 
frame [34] (see [10] for a better calculation). 

Also, there is an algorithm for turning a frame into an equal norm frame without changing the frame 
operator [25]. 

Casazza/Cahill |16j showed that the Paulsen Problem is equivalent to an old deep problem in Operator 
Theory. 

Problem 10.15. Given a projection P on with e-nearly equal diagonal elements of its matrix, what is 
the closest constant diagonal projection to P? 

10.5. Concrete Construction of RIP Matrices. Compressive Sensing is one of the most active areas 
of research today. See the book [56] for an exhaustive coverage of this subject. A fundamental tool in this 
area matrices with the Restricted Isometry Property, denoted RIP. Compressive sensing is a method 
for solving underdetermined systems if we have some form of sparsity of the incoming signal. 

Definition 10.16. A vector x = (oi, 02 , • • •, Qn) G is K-sparse if 

|{1 < i < Af : a* ^ 0}| < K. 

The fundamental tool in compressive sensing is the class of Restricted Isometry Property (RIP) 
matrices. 

Definition 10.17. A matrix 4> has the {K,S)- Restricted Isometry Property, RIP if 

(i-5)IN|2<||$xf <(M)||xf, 

for every AT-sparse vector x. The smallest <5 for which $ is (AT, (5)-RIP is the restricted isometry constant 
(RIC) 6k. 

The main result here is (see |56jh 

Theorem 10.18. Given 5 < 1, there exist N x M matrices with restricted isometry constant 6 k < 6 for 

K<c ^ 

- \n{N/Ky 


for a universal constant c. 
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This means, for example, in an A^-dimensional Hilbert space, we can find a set of lOOiV norm one vectors 
for which every subset of size iV/lOO is a (5-Riesz basic sequence. This is a quite amazing result. 
We know that in an iV-dimensional Hilbert space, any orthogonal set must have < N elements. This result 
says that if we relax this requirement just a little, we can find huge sets of vectors for which every subset of 
size a proportion of the dimension of the space is nearly orthogonal. 

In the language of frame theory, we are looking for a family of unit norm vectors $ = in 

so that every subset of $ of size a proportion of N is nearly orthogonal and M is much larger than N. 
The existence of such matrices has been carried out by random matrix theory. Which means we do not 
know concretely a single such matrix, despite the fact that these are essential for compressive sensing. For 
years, the closest thing to concrete here was a result of DeVore [45] which constructed N x M matrices 
for which subsets of size a/TV were 5-Riesz. But this is far from what we know is true which is subsets of 
size cN for 0 < c < 1 independent of N. Bandira/Fickus/Mixon/Wong [^ investigated various methods 
for constructing RIP matrices. Bourgain [14] then broke the square root barrier by showing we can 
concretely construct RIP matrices with subsets of size being i5-Riesz. There is also an important 

result of Rudelson/Vershynin [71] which says that if we take a random selection of rows from the Discrete 
Fourier Transform Matrix, then this submatrix will be a RIP matrix. Since these matrices are fundamental 
to compressive sensing, a longstanding, important and fundamental problem here is: 

Problem 10.19. Give a concrete construction of RIP matrices. 


10.6. An Algorithm for the Feichtinger Conjecture. For nearly 50 years the Kadison-Singer problem 
[55] has defied the best efforts of some of the most talented mathematicians of our time. It was just 
recently solved by Marcus/Spielman/Srivastava [55]. For a good summary of the history of this problem and 
consequences of this achievement see [25] . 

In his work on time-frequency analysis, Feichtinger [54] [38] noted that all of the Gabor frames he was 
using had the property that they could be divided into a finite number of subsets which were Riesz basic 
sequences. This led to a conjecture known as the Feichtinger Conjecture [38]. There is a significant body 
of work on this conjecture and we refer the reader to [26j for the best reference. 

First we need: 


Definition 10.20. A family of vectors {(pi}i^i is an e-Riesz basic sequence for 0 < e < 1 if for every family 
of scalars {oijig/ we have 

2 


(1- XI <(l + e)X 


ie/ 


iei 




The following theorem gives the best quantative solution to the Feichtinger Conjecture from the results 
of [69]. 

Theorem 10.21 (Marcus/Spielman/Srivastave). Every unit norm B-Bessel sequence can be partitioned into 
r-subsets each of which is a e-Riesz basic sequence, where 


and 




6{B + 1) 


in the real case 


in the complex case . 


This theorem could be quite useful, except that it is an existence proof. Now what we really need is: 
Problem 10.22. Find an implementable algorithm for proving the Feichtinger Conjecture. 


10.7. Classifying Gabor Frames. Gabor frames form the basis for time-frequency analysis which is the 
mathematics behind signal processing. This is a huge subject which cannot be covered here except for a few 
remarks. We recommend the excellent book of Grochenig [55] for a comprehensive coverage of this subject. 
We first define translation and modulation: 


Definition 10.23. Fix a,b > 0. For a function / £ L^(IR) we define 

Translation by a : Taf{x) = f{x — a), 
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Modulation by b : Mbf{x) = f (x). 

In 1946, Gabor |54j formulated a fundamental approach to signal decomposition in terms of elementary 
signals. Gabor’s approach quickly became a paradigm for the spectral analysis associated with time-frequency 
methods, such as the short-time Fourier transform and the Wigner transform. For Gabor’s method, we need 
to fix a window function g G L°°(R) and a,b G If the family 

“ {-MmbdlnagJm,nGZ 

is a frame for L^(R) we call this a Gabor frame. Gabor frames are used in signal processing. It is a very 
deep question which values of a, b, g give Gabor frames. There are some necessary requirements however. 

Theorem 10.24. If the family given by {g,a,b) yields a Gabor frame then: 

(1) ab < 1. 

(2) If ab = 1 then this family is a frame if and only if it is a Riesz basis. 

Also, the Balian-Low Theorem puts some restrictions on the function g G L^(R) for the case ab = 1. 

Theorem 10.25 (Balian-Low Theorem). If g G L^(]R), ab = 1 and {g,a,b) generates a Gabor frame, then 
either xg{x) ^ L^(R) or g' ^ L^(]R). 

2 

The Balian-Low Theorem implies that Gaussian functions e~°‘^ cannot yield Gabor frames for ab= 1. 
The main problem here is: 

Problem 10.26. Find all functions g and positive constants a,b so that {g,a,b) forms a Gabor frame for 
L2(M). 

Recently, a significant advance was made on this problem by Dai/Sun [48] when they solved the old and 
famous abc-problem. We refer to [48] for the history of the problem. In particular, Dai/Sun classified all 
triples (a, b, c) so that 

0{xi,ci, b) is a Gabor frame when |/| = c. 

10.8. Phase Retrieval. Phase retrieval is one of the largest areas of engineering with applications to x-ray 
crystallography, Electron Microscopy, Coherence Theory, Diffractive Imaging, Astronomical 
Imaging, x-ray tomography. Optics, Digital Holography, Speech Recognition and more [T^lTl [5T1 
[52117011111122]. For an introduction to this subject see Ini- 

Phase retrieval is the problem of recovering a signal from the absolute values of linear measurement 
coefficients called intensity measurements. Note multiplying a signal by a global phase factor does not 
affect these coefficients, so we seek signal recovery mod a global phase factor. 

There are two main approaches to this problem of phase retrieval. One is to restrict the problem to a 
subclass of signals on which the intensity measurements become injective. The other is to use a larger family 
of measurements so that the intensity measurements map any signal injectively. The latter approach in phase 
retrieval first appears in [3] where the authors examine injectivity of intensity measurements for finite Hilbert 
spaces. The authors completely characterize measurement vectors in the real case which yield such injectivity, 
and they provide a surprisingly small upper bound on the minimal number of measurements required for the 
complex case. This sparked an incredible volume of current phase retrieval research [HEllllEolESlEailellll] 
focused on algorithms and conditions guaranteeing injective and stable intensity measurements. 

Definition 10.27. A family of vectors $ = does phase retrieval on if whenever x,y G 

satisfy 

|(x,(pi)| = \{y,y}i)\, foralH= I,2---,M, 

then X = cy where |c| = I. 

A fundamental result in phase retrieval involves the complement property. 

Definition 10.28. A family of vectors in has the complement property if whenever we 

choose / C {1, 2, • • •, M}, at least one of the sets or spans H-^. 

Note that the complement property implies M > 2N — 1. For if M < 2N — 2 then we can choose 
/ = 1,2,---,A—1 and since the two induced subsets of our vectors each has only N —1 vectors, neither can 
span H-^. 

The fundamental result here is due to Balan/Casazza/Edidin [3]: 
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Theorem 10.29. In a family of vectors does phase retrieval if and only if it has the complement 

property. Moreover, there is a dense set of families of vectors which do phase retrieval. 

In the complex case, [3] showed that a dense sent of families of (4iV — 2)-vectors does phase retrieval. 
Later, Bodmann showed that phase retrieval can be done in the complex case with (4A^ —4) vectors. This 
was then improved by Conca/Edidin/Hering/Vinzant |42) . 

Theorem 10.30. In , there are families (in fact a dense set of families) of vectors which do 

phase retrieval. 

Again, phase retrieval cannot be done with fewer vectors than 4A^ — 4. 

Given a signal x in a Hilbert space, intensity measurements may also be thought of as norms of x 
under rank one projections. Here the spans of measurement vectors serve as the one dimensional range of 
the projections. In some applications, however, a signal must be reconstructed from the norms of higher 
dimensional components. In X-ray crystallography for example, such a problem arises with crystal twinning 
[47) . In this scenario, there exists a similar phase retrieval problem: given subspaces {Wn}^=i of an N- 
dimensional Hilbert space and orthogonal projections Pn : Wn, can we recover any x G 

(up to a global phase factor) from the measurements {||^’rax||}()^;^? This problem was recently studied 
in [6] where the authors use semidefinite programming to develop a reconstruction algorithm for when 
the {Wn}^=i are equidimensional random subspaces. Most results using random intensity measurements 
require the cardinality of measurements to scale linearly with the dimension of the signal space along with 
an additional logarithmic factor [22) . but this logarithmic factor was recently removed in [35) . Similarly, 
signal reconstruction from the norms of equidimensional random subspace components are possible with the 
cardinality of measurements scaling linearly with the dimension |^. 

In [17) it was shown: 

Theorem 10.31. Phase retrieval can be done on M.^ with 2N — 1 orthogonal projections of arbitrary rank. 
This theorem raises an important question: 

Problem 10.32. Can phase retrieval be done on R^ (respectively, C^) with fewer than 2iV— 1 (respectively, 
4iV — 4) projections? If so, what are the fewest number of projections needed in both the real and complex 
case? 
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